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Nair: The paper by Box and Meyer deals with some 
interesting problems that arise in the off-line quality con- 
trol methods introduced by Taguchi (see Taguchi and 
Wu [l] 2 ). My comments will be restricted to the first 
part of the paper, viz. estimating dispersion effects. 

1) Estimating dispersion effects for quality control 

In industrial experiments designed to detect important 
factors that affect the quality of a manufacturing/ 
production process, the estimation of dispersion effects 
is as important as the estimation of location effects. In 
fact in situations where there are readily identifiable 
signal factors (see [1]), the primary goal is in estimating 
dispersion effects. The location effects, in this case, play 
the role of nuisance parameters. Leon, Shoemaker and 
Kackar [2] offer an excellent discussion of the statistical 
formulation of the parameter design problem in indus- 
trial experiments. 

2) Effect sparsity 

The Box-Meyer techniques exploit the notion of ef- 
fect sparsity to obtain "replicates" in an unreplicated 
experiment. It is likely that in most cases only a few 
factors are highly significant. However, in many situ- 
ations, one could also expect many of the other factors 
included in the experiment to have sizeable effects. This 
is particularly true when a fair amount of the informa- 
tion about the process is known and is used in the selec- 
tion of the factors. In such situations, one could not 
reasonably expect to estimate both location and dis- 
persion effects from an unreplicated experiment. 
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3) When to log? 

Box suggests using log[S 2 (f — )/S 2 {j'+)l as a pre- 
liminary estimate of the dispersion effects. An alterna- 
tive method would be to take log of the squared re- 
siduals and do ANOVA with an additive model for the 
log of the scale parameters. This is the type of analysis 
usually done in experiments with replications. Some ef- 
ficiency calculations suggest that the Box-Meyer anal- 
ysis is more efficient when there are only a few large 
dispersion effects and less efficient when there are many. 

4) Iterating 

It is possible that during the first step of the iteration 
(which does an unweighted analysis) some significant 
location effects are not detected. So after the dispersion 
effects are estimated, the location model should be re- 
fitted for all the factors. 

5) Transformations 

In replicated experiments, the quasi-likelihood mod- 
els of Nelder and Pregibon [3] allow one to determine 
the transformations under which the location effects and 
the scale effects are approximately additive. 
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Frenklach: Professor Box presented a method of 
analysis of factorial designs for detection of main effects 
and faulty observations. The approach is analytical and 
provides numerical measures for what previously has 
been approached graphically. The availability of the 
analytical algorithm is important for computerization of 
the analysis. 

The central hypothesis of the method is what the 
authors call effect sparsity, which states that usually 
only a small number of input and control process vari- 
ables would have a significant effect on the process 
response(s). This situation appears to be true not only in 
experimental environments but also in computer mod- 
eling of various industrial processes and natural phe- 
nomena. Mechanistic models usually take the form of 
differential equations for which no analytical solution is 
available. The model may contain a large number of 
(physical) parameters and it is not always obvious from 
a simple inspection of the computational results what 
effect each parameter has on a given response or re- 
sponses. Sensitivity analysis has been used to reveal this 
information. Among other techniques, the use of screen- 
ing factorial designs for sensitivity analysis of computer 
models has been suggested by Box et al. 1978; Frenklach 
1984; Frenklach and Bornside, 1984; Miller and Fren- 
klach, 1983; and Morris and Mitchell, 1983 [1-5]. 

The present experience with chemical kinetic mod- 
eling, for example, is as follows. Due to technical diffi- 
culties of instrumentation, there are only a few experi- 
mental responses available, typically one or two. The 



cases studied indicate that it is a very small number of 
chemical reactions, out of hundreds of reactions com- 
prising the model, whose rate coefficient values, within 
their uncertainty intervals, have significant or "active" 
effects on the experimentally verifiable model re- 
sponses. These are exactly the conditions of effect spar- 
sity discussed above. Thus, the method presented by 
Box is well-suited not only for "real" experimentation, 
but also for computer modeling. 

Computations, however, do not have random errors. 
Does this fact simplify and economize the analysis? 
Should special methods and designs be developed or 
existing ones modified for a most efficient use in screen- 
ing analysis of computer models? 
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